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ABSTRACT 

In  this  work  we  describe  globally  convergent  Iterative  procedures  for 
generating  a  minimizing  sequence  for  the  problem  of  finding  the  infimum  for 
the  function  #(x)  «  \  f^(x)  on  a  certain  set  D.  The  minimizing 
sequence  consists  of  points  of  the  infimum  for  functions  of  the  type 
\  [B^g^tXff  ^(x) )  +  <y^,x>],  where  the  transforming  functions  g^(x,»)  are 
chosen  in  such  a  way  that  the  compositions  g£<x,fi(x))  are  simpler  than  the 
given  functions  f^(x) f  and  where  the  coefficients  B^  >0,  Yi  e  Rn, 
i  *  1,...,m,  are  determined  by  the  choice  of  g^.  Various  classes  of  the 
functions  g^  are  considered  and  global  convergence  results  are  proved.  It 
is  shown  that  many  well-known  algorithms,  for  example,  Weiszfeld's  algorithm 
and  Newton's  method  are  particular  cases  of  the  general  method. 
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SIGNIFICANCE  AND  EXPLANATION 


^  The  method  developed  In  this  paper  applies  to  a  number  of  nonlinear 

minimization  problems.  The  bibliography  includes  the  numerical  implementation 

/  -  i 

for  several  applied  problems.  The  main  advantages  of  our  approach  are: 
generality  of  the  technique,  global  convergence  of  the  method,  its  ease  of 
formulation  and  implementation,  and  its  numerical  efficiency.  The  method  can 
be  extended  to  variational  problems. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


GLOBALLY  CONVERGENT  PROCEDURES  FOP  SOLVING  NONLINEAR  MINIMIZATION  PROBLEMS 


Alexander  Fydeland 

1.  In  this  paper  we  discuss  the  method  of  nonlinear  transformation  of  the  objective 
function.  This  approach  has  proved  to  be  a  convenient  tool  for  generating  and  analyzing 
optimization  procedures.  The  method  is  based  on  the  following  simple  observation.  The 
minimization  problem  for  a  given  function  f(x),  x  e  R*1,  can  be  replaced  by  the  problem 
of  minimizing  the  composition  g(f(x)),  where  g(a)  is  a  monotone  function,  provided  that 
the  minimization  problem  for  g(f(x))  can  be  solved  with  less  effort  than  the  original 
problem  of  minimizing  f(x).  Of  course  the  minimum  points  for  both  functions  coincide. 


that 

lim  *(x*t)  ■  inf  *(x)  i 

k-K»  xeo 

m 

(1)  *<x)  -  )  f.(x)  ; 

i-1 


ft(x)  >0,  i  -  1, . . . ,m  , 


where  D  is  a  convex  set  in  IT.  The  assumption  that  the  given  functions  f,(x)  are  non-  < 

negative  is  made  for  convenience  and  does  not  lead  to  the  loss  of  generality.  Assume  that 

we  can  find  a  set  of  functions  g. (x,a),  i  *=  1,...,m,  such  that  the  compositions 

i  ( 

g^(x,f^(x))  are  simpler  than  the  functions  f^(x)  (for  example,  the  g^X'f^tx))  are  j 

i 

quadratic  or  linear  functions )e  Can  we  use  the  existence  of  the  simplifying  functions  1 

i 

i 

g^  in  order  to  construct  an  iterative  procedure  which  determines  a  minimizing  sequence  for  • 

j 

the  problem  (1)7  In  this  paper  we  make  an  attempt  to  answer  this  question.  We  construct  a  j 

minimizing  sequence  for  the  problem  (1)  which  consists  of  points  of  infimum  of  functions, 

m  [ 

whose  general  form  is  \  (x, f ^(x) )  <Y^,x>),  where  >  0  and  ^  8  R  .  By  , 
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virtue  of  the  assumption  above,  the  problem  of  finding  points  of  infimum  for  these  linear 
combinations  is  simpler  than  the  original  problem  ( 1 ) . 

In  the  sections  2,  3,  4  and  6  we  consider  various  classes  of  functions  $(x)  and 
g^(x,a),  construct  the  corresponding  iterative  procedures  and  prove  convergence 
results.  Some  of  those  results  are  from  the  papers  [3],  [5]  and  we  only  state  them  without 
proofs.  Other  results  are  new  and  we  consider  them  in  detail.  We  do  not  discuss  numerical 
applications  of  the  method  in  this  paper,  although  they  are  numerous.  For  some  numerical 
examples  we  refer  the  reader  to  the  papers  [1],  [2).  Other  important  applied  problems  will 
be  considered  in  forthcoming  papers.  In  Section  5  we  show  that  some  of  the  well-known 
optimisation  procedures,  such  as  Weissfeld's  algorithm  and  Newton's  method,  are  particular 
cases  of  the  method  of  nonlienar  transformation  of  the  objective  function.  Throughout  this 
paper  the  superscript  k  denotes  the  iteration  number. 

2.  We  start  with  the  simplest  case  when  the  functions  gi  depend  on  a  only  and  for 
every  i  «  1, ... ,m 

gi(a)  >  0  for  a  >  0  , 

(2)  g^a)  is  convex  tor  a  >  0  , 

g^a)  e  cV,-),  gJ(fA(x))  >«>o  vxcd, 

where  6  is  some  positive  constant.  We  assume  that  for  every  set  of  positive  constants 

m 

Cj,  i  -  1,...,m,  the  set  Arg  inf  J,  Cjg^tf^Cx))  *  0,  where  for  any  function  f(x) 

xectD  i“1 

and  any  set  B  the  set  Arg  inf  4>(x)  (Arg  min  f(x))  is  the  set  of  all  points  of  infimum 

x«B  xeB 

(minimum)  for  the  function  f(x)  in  the  set  B.  Now  we  consider  the  following  iterative 
procedure : 

x°  e  D  is  an  arbitrary  initial  points 

(3)  for  k  -  0,1,2,... 

m 

xk+1  e  Arg  inf  \  g,(f  ,(x)  >/g!(fi(xk) )  . 
xectD  i-1 

For  this  procedure  we  can  prove  the  following  results. 
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Theorem  1 .  Let  the  function  ♦(x),  defined  in  (1),  be  convex,  let  the  functions  f^(x), 
i  ■  be  continuous  on  ciD,  non-negative  and  finite  in  D  and  let  the  functions 

g^fo)  satisfy  the  conditions  (2).  If  the  sequence  {x  },  determined  by  the  procedure 
(2),  has  a  bounded  subsequence  then 


♦  (x  )  +  inf  4(x)  as  k  ♦  • 
xeo 


Proof.  We  introduce  the  function 


(4)  $(x,y)  «  *(y)  +  ),  Ig^f^x))  -  gi(f1(y)  Jl/gllfiJy) ).  x,y  e  D 

i-1 

From  (3)  and  the  definition  (4)  of  the  function  ^(x,y)  if  follows  that 

...  k+1  k,  „  k  k,  ..  k. 

(5)  $<x  ,x  )  <  *(x  ,x  )  -  *(x  )  . 

On  the  other  hand 


,,  k+1  k,  k+1,  ,  ...  k.  k+1.. 

4(x  ,x  )  «  4(x  )  +  (4(x  )  -  *(x  )) 


♦  1  lgi(fi<xk+1))  -  gJ(fi(xk))]/g|(f1(xk)) 

i»1 


♦<x* M>  ♦  ^  [gi,(f  i.(xk+1 ) )  -  )) 


g[(f1(xk))(fi(xk+1)  -  fi(xk))]/g[(fi(xk)) 


Each  term  in  the  square  brackets  in  the  last  sum  in  (6)  is  non-negative  by  virtue  of  the 
convexity  of  the  functions  g^{o).  Since,  by  (2),  g|(f^(xk))  >  6  >  0,  we  finally  have 
that 

(7)  ♦<xk+\xk>  >  4(xk+1)  -  ♦<xk+\xk+1)  . 

Combining  the  inequalities  (6)  and  (7)  together  we  obtain  the  sequence  of  inequalities 


k+1  k+1,  .  ..  k+1  k,  ,  k  k,  , 

...  *(x  ,x  )  <  *(x  ,x  )  <  *(x  ,x  )  <  ...  , 


(8) 


*  *r. 


v-f  1  v+  Ik  k 

...  <  *(x  )  <  *<x  ,xK)  <  »(xK)  <  ... 


The  function  4(x)  is  bounded  from  below.  Therefore  there  exists 


lim  *(x  )  «  ♦  . 
k*» 


We  shall  prove  now  that  ♦  *  inf  *(x).  By  the  assumption  of  the  theorem  there  exists  a 


k  k  ku 

subsequence  {x  }  of  the  seauence  {x  }  such  that  x  ♦  x  e  ciD  as  v  ♦  *.  It  is 


clear  that 


_  V  V+ 1  V 

♦(x)  >  4  »  lim  4(x  )  =  lim  4(x  ,x  )  . 


Let  us  assume  that 


♦  »  «(x)  >  inf  4(x)  . 
xeD 


Then  there  eixsts  a  point  x*  e  D  such  that  the  right  directional  derivative 


d  .  -..i  *(x  +  t ( x*  -  x))  -  *(x)  .  „ 

—  *(x  +  r(x*  -  x))l  .  *  lim  - - -  <  0  . 

dr  |t-0  t+0  t 


Taking  into  account  that  for  every  pair  of  points  ,x2  e  clD 


^♦(*1  +  t(*2  "  V'VIt-O  +  t(x2  - 


we  obtain  from  (12)  that 


4(x  ♦  t(x*  -  x),x)|T-(J  <  0  • 


This  inequality,  convexity  of  the  function  ♦(x,y)  with  respect  to  x  for  every  fixed 


y  «  ctD  and  the  results  of  $24  of  [8]  imply  that  there  exists  a  point  *  “  x  ♦  T(x*  -  x), 


t  e  (0,1],  such  that 


♦<*,x)  <  4(x,x) 


Since  the  function  +(x,y)  is  continuous  and  x  ♦  x  as  v  ♦  from  the  inequality 


above  it  follows  that  there  exists  vQ  such  that 


$(s,x  )  <  ♦(x^) 


v**\ V *  V  V  NlV  V  ‘.V,  v  *.  ■»  *.'.  V'.*  v  ^  v  v  %'  ••  .. , ,  rt 


for  v  >  vQ.  By  (3)  from  this  inequality  it  follows  that 

k  +1  k 

<fr(x  V  ,x  v)  <  *(x,x),  U  >  VQ  , 

k-*- 1  k  -  - 

which  contradicts  the  fact  that  by  (8)  and  (10),  ♦(x  ,x  )  >  <t(x,x)  =  *  for  all 

k  •  0,1,...  .  Therefore  the  assumption  (11)  was  false  and 

4(x)  "  lim  *(xk)  «  inf  ®(x)  . 
k-w*  xen 


The  theorem  is  proved. 

In  the  following  theorem  we  remove  the  condition  of  the  existence  of  a  bounded 

,  k, 

subsequence  of  the  sequence  lx  ) . 

Theorem  2.  Let  the  functions  *(x)  and  f^x),  i  =  1,...,m,  satisfy  the  conditions  of 
Theorem  1.  Moreover,  let  the  functions  f^(x)  be  convex  outside  a  circle  of  some  radius 
R.  Then 

♦  (x*')  +  inf  4(x)  as  k  ♦  •  , 

xen 

x 

where  the  sequence  {x  }  is  determined  by  (3). 

y 

Proof.  If  the  sequence  {x  }  has  a  bounded  subsequence  then  the  assertion  of  the  theorem 
follows  from  Theorem  1.  Let  us  assume  now  that  |xk|  *  «■  as  k  ♦  We  consiAer 
seperately  two  cases. 

A)  In  this  case  we  assume  that  there  exists  a  point  x*  e  ciD  such  that 

♦(x»)  -  inf  *(x).  Since  the  sequence  {(xk  -  x*)/|xk  -  x*|}  is  bounded  for  all  k  there 

xen 

exists  a  recession  direction 

k  +1  k  +1 

(14)  5  -  lim  <x  U  -  x* ) / | x  V  -  x*| 

V+" 

k  +1 
,  V  i 

for  some  subsequence  {x  ),  v»0,1,...  .  Consider  now  the  set 


U) 


n  h  n  ctD  , 

f.  R 


where  6 


is  a  small  positive  constant,  the  cone 


{x*  +  in |t  >  0; 
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r'®R*  fof*t»  1*1  —  €(<e},  a  closed  half-space  HR  is  chosen  in  such  a  way  that  for 
£ 

all  n  €  n  |h|  >  R.  It  is  clear  that  the  set  in  is  convex  if  e  is  sufficiently 
snail/  and  that  <n  is  relatively  closed.  By  the  assumptions  of  the  theorem  the 
functions  fi(x)  are  convex  in  u>.  Now  we  introduce  the  set 

n  =  ct{0  e  Rm|  3  x  e  0)  such  that  >  f  (x),  i  «  I, . . .  ,m}  . 

The  set  fl  is  convex.  Indeed  let  ft*  and  ft"  belong  to  Q.  Then  there  exist  points 

x-,x"  e  m  such  that  ft’  >  f^x* ),  BJ  >  f^x"),  i  =  1 . .  Hence  the  point 

Xft1  +  (1  -  X)8",  X  p  10,1],  also  belongs  to  SI  since,  by  convexity  of  the  functions 


f4(x)  in  (i). 


X8^  +  (1  -  X)ft*  >  fi(Xx*  +  <1  -  X )x" ) ,  i  -  1 . m  . 


On  the  set  fl  *  fl  we  introduce  the  function 

m  m 

(15>  *.(0,6)-  ).  6  +  l  [g.  «*>  -  g.  (B)]/g'<8>  . 

i-1  i-1  1  1  1 

It  is  obvious  that  if  ai  -  f^x),  6i  -  f^y),  x,y  e  D,  i  -  1,...,m,  then 
♦  ^0,8)  -  <Mx,y),  see  (4). 

By  the  definition  of  the  set  <i)  and  by  (14)  we  may  assume,  without  the  loss  of 
k  +1 

generality,  that  x  6  u,  v  —  0,1,..,  .  As  in  Theorem  1  we  can  prove  that  ♦(x*S  ♦  ♦ 
*•  k  *  •,  where  S  is  some  positive  constant.  Therefore 

k  _  k  +1  k 

C*6)  *(x  )  +  ♦,  *(x  V  ,x  V)  ♦  *  as  v  ♦  »  . 


Let  us  assume  that 


(17>  •  >  inf  *(x)  =  *(x*)  . 

xeo 

k  +1 

Consider  now  a  new  sequence  {z  },  v  -  0,1,...,  defined  as  follows: 

k  +1  k  +1 
V  V 

z  -  [x  ,x*]  n  3w,  v  -  0,1,...  , 

V1  V1 

where  by  (x  ,x*]  we  denote  a  segment  of  a  straight  line  between  x  and  x*. 

k  +1 

c  v 

Since  x*  is  the  vertex  of  the  cone  K. ,  the  point  z  always  exists  and,  by 

k  +1 

v 

closedness  of  «,  z  P  (a,  v  -  0,1,...  .  Moreover  from  the  definition  of  the  set  u> 


«■  v  v  *>  *.  . 


k  +1 
v 


it  follows  that  the  sequence  {|r  -  x*!}  is  bounded  by  some  constant  T(R,e).  By 

convexity  of  the  function  *(x) 


k  +1  k  +1 

o  <  uus  1  >  -  n»«)  <  k.l—x_L 

k  +1  k  +1  1 

•  (x  V  )  -  ♦(x«)  |x  V  -  x* | 


v  »  0, 1 , . . .  . 


k  +1 

As  v  ♦  •  the  denominator  *(x  )  -  ♦  (x*)  ♦  5  -  *(x*),  which  is  not  equal  to  zero  by 

V1 

the  assumption  (17),  and  ■■■  X  <  —  T^f £2 -  ♦ 

k  +1  k  +1 

|x  V  -  X*|  lx  V  -  X* 

Therefore 


k  +1 

i  v  , 

0,  since  x  -  x*  ♦  ». 


(18) 


k  +1 

*(z  V  )  +  *(x*)  as  v+» 


k  +1  k  +1  k 

Thus,  there  exist  in  oi  two  sequences  {x  }  and  {z  }  such  that  ®(x  v)  ♦  *  and 


k 

k  + 

•  u  v)  + 

inf  •Nx)  as  v  ♦  «•. 

He  consider  the  corresponding  sequences  (B 

Vi ' 

xeD 

<Y  V  > 

in  Sit 

k  +1  k  +1 

k  +1  k  +1 

(19) 

■  f±(x  ), 

YiW  -  fA(z  V  )  ,  i  -  1,...,m»  v  «  0,1,.., 

From  (16) 

we  have  that 

m  k  +1 

(20) 

}.  B  V  +  *  as  v  , 

i-1  1 

and  from 

(18) 

m  kv+1 

(21) 

\  y  *  *(x*)  as  v  ♦  •  . 

i=1 

k  +1  k  +1 

From  (20)  and  (21)  and  from  the  fact  that  B^  >  0,  y  u  >0,  i  «  1,...,m, 
u  »  0,1,..,,  we  obtain,  taking  smaller  subsequences  if  necessary,  that 
k  +  1  _  k  +1 

(22)  B^V  ♦  y4W  +  yl  as  v  ♦  »,  i  -  1,...,m  . 


Since  SI  is  a  closed  set.  Bed  and  y  e  0.  From  (20),  (21)  and  (22)  it  follows  that 
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» 


(23) 


m  m 

I*,-*.  I  V  *(x#) 

i-1  i-1 


Finally  from  the  assumption  (17)  it  follows  that 

m  m 


(24) 

Let  us  prove  now  that 

(25) 


>  ^  rt 

i-1  i-1 


k  +1  k 

0  V  e  Arg  min  4  (8,8  ),  u 

Bed 


0,1,. 


where  0  -  fix  ),  i  -  1,...,m  and  the  function  4  (a, 8)  is  defined  in  (15).  Indeed, 

11  k  1  k  +1  k 

if  there  exists  a  vector  a  e  fl  such  that  41(°>0  V)  <  4^(8  V  ,B  V)  then,  by 

monotonicity  of  the  g, (a)  and  by  the  definition  of  0,  there  exists  a  point  z  e  w  such 
k  1  k  +1  k 

that  4.|(F(z),0  w)  <  ♦1(6  V  ,B  V),  where  for  every  sew  the  vector  function  F(z)  is 

defined  as  follows:  F^lz)  -  f^(z).  Therefore,  recalling  the  definitions  of  the  functions 

k  k  +1  k 

V  V  V 

4  and  4,  we  obtain  that  4(z,x  )  <  4(x  ,x  ).  The  inequality  obtained  contradicts 

1  k  +1 

v 

the  definition  of  x  ,  see  (3).  Thus  (25)  is  proved. 

Let  us  prove  now  that 


(26) 


$r  v*  ♦ ^ -  ?,'?>ix-o  >  ° ' 


where  the  definition  of  the  right  derivative  d  /dr  is  given  in  (12).  If  we  assume  that 

this  directional  derivative  is  negative  then,  by  convexity  of  the  function  4 1 (a  ,8 )  with 

respect  to  a  for  any  fixed  6,  there  exists  a  point  a  e  fl  such  that 

4.(«,B)  <  4, (8,8).  Therefore,  since  4.(a,6)  is  continuous  with  respect  to  6,  it 

-  *v 

follows  from  (22)  that  for  some  large  v,  4  (a, 6  )  <  4.(8, 8).  By  (25)  this  means  that 

k  +1  k  m  k  +1  k 

4,(0  V  ,0  V)  <  4,(0, 0)  “  ).  0..  Recalling  (23)  and  the  fact  that  4,(8  ,8  >  “ 

k  +1  k  1 

V  V 

+<x  /X  )  we  obtain  that 


V1  \ 

4,(x  ,x  )  <  4  , 


which  contradicts  (16).  Thus  the  inequality  (26)  holds.  Calculating  the  derivative  in 


-8- 


(26)  we  obtain  that 


m  m 

(27)  1  Y  -  l  6.  >  0  , 

i-1  i-1 

which  Is  in  contradiction  with  the  assumption  (24).  Therefore  the  assumption  (17)  is  false 
and 

•  (xk)  +  5  -  *(x*)  -  Inf  *(x)  as  k  +  •  . 
xeo 

Thus  the  part  A)  of  the  theorem  is  proved.  Consider  now  the  second  case. 

B)  The  minimising  sequence  {y*},  t  -  0,1,...,  such  that  • ( y* )  1  inf  *(x)  as 

t  *eD 

i  ♦  is  unbounded.  Taking  y  instead  of  x*  and  repeating  the  arguments  of  the  part 

A)  we  can  obtain  in  the  same  manner  as  we  have  obtained  the  inequality  (27)  that 

•  (y*)  >  *,  (  ■  0,1,...  .  From  this  it  follows  that  lim  $(yS  *  inf  ®(x)  >  ♦.  On  the 

xeD 

other  hand  inf  d(x)  <  i,  since  i  -  lim  t(x  ).  Therefore  inf  *(x)  -  *  and  the  theorem 
xeD  k+*  xeD 

is  proved. 

To  complete  the  investigation  of  the  procedure  (3)  we  prove  several  results  concerning 

the  rate  of  convergence  of  that  procedure. 

It  is  clear  that  the  rate  of  convergence  for  procedure  (3)  depends  on  the  choice  of 

the  functions  gA(a).  Below  we  shall  prove  several  estimates  for  the  convergence  rate 

under  various  conditions  on  the  g^Ia).  We  shall  always  assume  that  there  exists  a  point 

x*  e  Arg  inf  d(x)  c  ciD. 
xeD 

First  of  all  we  observe  that,  by  (7),  (3)  and  (4), 


•<xk+1)  <  inf  *(xk  +  T(x*  -  xk),xk)  - 

xe[0,1] 


inf  {*<xk)  +  \  (g  (f-  (xk  +  T(x*  -  xk)))  -  g  ( f  (xk) )  ] /g'  (f  (xk) ) } . 

te[0,1]  i-1 


It  is  obvious  that  by  continuity  we  can  replace  inf  by  min  above.  Hence 


«5 


m 

K 


3 


| 


ft4. 

I 


V' 


V 


♦  (xk+1)  <  •(xk)  +  min  {•(x*t  +  t(x*  -  xk))  -  $(xk) 

te[o,i] 


f i(Xk+T(X*“Xk) ) 


f^x*) 


dalg^s)  -  g[(f1(xk))]/g^(fi(xk))j 


Now  we  use  the  inequality  (28)  to  prove  the  following  lemma. 

Lemma  3.  Let  *(x)  be  a  convex  function  and  there  exiata  x*  e  Arg  inf  t(x).  Then  the 
following  convergence  eatimatea  hold. 

A)  If  the  functiona  fA(x)  and  gJUjtx)),  i  -  1,...,a,  are  convex  then 

*<xn)  -  *<x*)  <  (C,  +  C2n)-1,  n  -  0,1,...  , 

where  C.,  and  C2  are  poaitive  conatanta. 

P, 

B)  If  gA(a)  «  G^o  ,  i  -  1,...,e,  >  0,  1  <  p^  <  2,  and  if  the  functiona 


f,(x)  are  convex  then 


*<xn)  -  *<x*)  <  (C3  ♦  C4n)-\  n  -  0,1, 


where  C3  and  C4  are  poaitive  conatanta. 

C)  If  the  functiona  fA<x),  i  •  1,...,m,  are  convex,  if  the  eequence  {x  }  from 

(3)  ia  bounded,  if  the  functiona  g3  «  C2 (^.1 ,  i  »  1,...,m,  and  *i<fi<*>>  <  M, 

i  -  1,...,a,  x  e  D,  M  >  0,  and  if  there  exiata  a  poaitive  q,  1  <  q  <  2,  auch  that 

(29)  «(x)  -  «{x*>  >  n|x  -  x*|q,  x  e  D  , 

where  n  is  a  poaitive  constant,  then 


1)  if  q  -  2 


where  0  <  Q.  <  1» 


♦(x")  -  *(x*)  -  <*<x°)  -  ♦(x*))o",  n  -  0,1,...  , 


li)  if  1  <  q  <  2  there  exists  a  number  n^  such  that 


( 2/q)  -a(n-n0> 


(31)  ♦(x")  -  *(x»)  <  Q2 

where  0  <  Q2  <  1  and  a  is  some  constant. 


n  -  "o'  no  + 


TTSJJJ 


V  /  / 1 


Proof  of  A) .  The  function  g^(a),  i  »  ere  increasing  functions.  Therefore  the 

inequality  (28)  can  be  replaced  by  the  following  inequality: 


4(xk+1)  <  4(xk)  +  min  |4<xk  +  t(x*  -  xk)>  -  *(xk> 
Teto.i] 

n 

+  1  +  T(x*  -  xk)))  -  g'(f  (xk)))  • 

i-1  1  1  11 

<fi<Xk  +  T(X*  -  Xk))  -  fA(Xk) )] f Xk> ) }  . 


By  convexity  of  the  functions  4(x),  g^(f^(x))  and  f^(x),  i  •  1,...,m,  we  obtain  that 


♦(x**1)  <  *(xk)  +  min  [t(4(x*>  -  ♦(xk)) 


Te(0,1J 


(32) 


m  2 


+  1  T~  [gi(fi(x*))  -  ^(f^**))]  I*i(**)  -  ^(x*)]  , 


i-l 


where  5  is  determined  in  (2).  From  Theorem  2  we  know  that  the  sequence  {•(xk)} 
converges.  Therefore,  since  the  functions  f  ^(  x)  are  non-negative,  the  sequences 
{f^x  )},  i  -  1,...,m,  are  bounded.  Hence  from  (32)  if  follows  that 


k-fl  k  k  2 

(33)  *(x  )  <  *(x  )  •*■  min  [r(4(x*)  -  *(x  ))  *  m  ]  . 

Te(0,1J 


where  M  is  the  bound  for  j  \  tg^lfj^fx*))  -  gj(fi(xk)))  [fjtx*)  -  fi(xk)l  k  -  0,1,... 

i«1 

k  k 

Denoting  4(x  )  -  ♦(x*)  by  m  we  can  rewrite  (33)  as 

lik+1  <  min  [(1  -  T)pk  +  t2M]  . 

te[0,1] 

Optimal  t  is  jik/2M.  Therefore 

(34)  pk+1  <  Uk  -  (pk)2/(2M)  . 


By  the  standard  technique,  for  example  see  [1],  we  obtain  from  (34)  that 


,  vv'. 


-1  2 

0  0 

where  C1  «  y  «  $(x  )  -  4(x*),  C2  -  1/2M 


yn  <  (C,  +  C,n)_1,  n  »  0,1,...  , 


Proof  of  B) .  We  consider  this  case  separately  because  it  appears  frequently  in 


applications.  First  we  observe  that  from  (2)  and  from  the  condition  that  g  (a)  »  G.a 

VPi 

it  follows  that  for  every  x  e  D,  f^(x)  >  5.,  i  -  1,...,m,  where  i.  «  (5/G.)  •  F: 


(28),  from  convexity  of  *(x)  and  concavity  of  the  functions  g|(a)  it  follows  that 


V+1  k  v 

*(x  )  <  4(x  )  +  min  (t(*(x*)  -  *(x  )) 


(pi  “  11  2  T  k  2 

+  ~~l -  T  1  (f±(x*)  -  f^x*))* 


Te[0,i) 

m 

1 

i-1 

After  this  the  proof  of  B)  can  be  completed  in  the  same  way  as  was  done  in  part  A). 
Proof  of  C) .  From  (28),  convexity  of  *(x)  and  the  condition  that  gjlfj^x))  <  M  it 
follows  that 


♦(xk+1)  <  ♦(xk)  +  min  [t(*(x*)  -  *(xk)) 


(35) 


Tero,u 
m 


+  fr  l  (f  <xk  +  T(x*  -  Xk))  -  f^X*))2  , 
i-1 


where  6  is  defined  in  (2).  Since  by  the  condition  of  the  lemma  there  exists  a  bounded 
convex  set  S  C  ctn  such  that  xk  e  S  for  every  k  >  0,  we  can  use  the  results  of  $24 


from  (8]  to  prove  that  max  ~  f,(xk  +  s(x*  -  xk))  <  F  for  k  -  0,1,...  and 

seto.i]  ds 


i  -  1,...,m,  where  F  is  some  positive  constant.  Therefore  it  follows  from  (35)  that 


*(xk+1)  <  *(xk)  +  min  (t(4(x*)  -  *<xk))  +  t2(x«  -  xk)2]  . 

Te[0,1]  2S 


From  the  condition  that  (x*  -  x*)2  <  [—  ( •  ( x* )  -  ♦(x*))J2^q  we  have,  denoting  as  usual 


*(xk)  -  *(x*)  by  pk,  that 


(36) 


y  <  yk  ♦  min  [-Tyk  +  L(yk)2/^r2J  , 


k+1 


te[0,1] 


2/q 


where  L  m  M P/(26n  Without  loss  of  generality  we  assume  that  L  >  1/2.  If  o  »  2, 


12- 


which  is  the  case  of  a  twice  differentiable  4(x),  then  we  take  in  (36)  the  optimal 
T  “  1/2L  and  obtain 


k+1  k 

U  <  U  (1  -  1/4L)  . 

Hence 

.  n  .  O.n  .  . 

U  *  U  0)i  n  “  0, 1 , . . .  , 

where  p  “  1  -  1/4L  <1,  p  >  0  since  L  >  1/2.  Thus  we  have  proved  the  inequality 

Jc 

(30).  If  1  <  q  <  2  then  there  exists,  by  Theorem  2,  a  number  ng  such  that  u  <1  for 
all  k  >  n°.  We  take  Tk  «  1  for  k  >  nQ  in  (36)  and  obtain 

k+1  ,  .  k ,2/q 

M  <  L(y  )  ,  k  »  nQ,  nQ  +  1,...  . 

n 

From  this  the  inequality  (31)  follows  with  a  »  log^L ,  b  »  y  .  Hie  lemma  is  proved. 

If 

In  Lenna  3  we  have  investigated  only  the  convergence  of  the  sequence  {*(x  )}  to 
•(x*).  If  one  is  interested  in  convergence  of  the  sequence  {x  }  to  x* ,  provided  that 
this  convergence  takes  place,  one  can  easily  obtain  the  necessary  estimates  using  the 
standard  technique,  which  combines  the  results  of  Lemma  3  and  inequalities  similar  to  the 
inequality  (29). 

Remark.  In  Lemma  3  we  have  considered  only  few  possible  cases,  although  frequently 
encountered  in  applications.  Our  intention  was  not  to  investigate  all  cases,  but  rather 
to  suggest  an  approach  to  the  problem  of  finding  the  rate  of  convergence  for  the 
procedure  (3). 

3.  We  now  consider  a  wider  than  in  Section  1  class  of  problems  to  which  we  can  apply  the 
method  of  nonlinear  transformation  of  the  objective  function.  In  this  section  we  remove 
the  last  condition  in  (2)  and  assume  that  each  function  g^a)  satisfies  the  following 
conditions  for  every  i  «  1,...,m: 

(37a)  9i(«)  >  0,  gi(o)  is  convex  for  a  >  0» 

(37b)  gj(a)  >  0  for  a  >  0>  there  exist  an  interval  [0,r] 

and  continuous  functions  F^tu)  and  G^(v)  such  that 
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* 


As  in  Section  2  we  assume  that  the  set  Arg  inf  \  c^g^tf^Cx))  *  0  for  every 

xeclD  i” 1 

collection  of  positive  coefficients  Cj,...,cm  and  that  the  problem  of  finding  a  point  in 
this  set  is  easier  numerically  than  solving  the  original  problem  (1).  For  the  procedure 
(38)  we  can  establish  the  following  results  (see  proofs  in  [5]). 

Theorem  4.  Assume  that  the  functions  f^(x),  i  “  1, ...,m,  are  convex,  finite  and  non¬ 
negative  in  ciD.  If  the  functions  g^ (a) ,  i  -  1,...,m,  satisfy  the  conditions  (37a-e) 


♦  <x  )  *  inf  *<x)  as  k  ♦  •  , 
x€D 

X 

where  the  sequence  {x  }  is  determined  in  (38). 

Theorem  5.  Let  the  functions  fj^x),  i  -  1, . . . ,m,  be  non-negative  and  let  their  right 
directional  derivatives  be  upper-semicontinuoua  in  ctD  *  Hn.  Let  the  function  ♦ (x)  be 
pseudo-convex  in  D  and  let  its  right  directional  derivative  be  upper  semicontinuous  in 
ctD  x  nn.  Assume  moreover  that  for  every  y  >  0  the  sets  *  {x  e  o|*(x)  <  y)  are 
bounded.  If  the  functions  g^a),  i  -  1,...,m,  satisfy  the  conditions  (33a-e)  then 

♦(xk)  ♦  inf  «(x)  as  k  ♦  - 
x€D 

where  the  sequence  {x  }  is  determined  in  (38). 


4.  In  this  section  we  consider  a  new  class  of  transforming  functions.  The  functions 
g^,  i  -  1,...,m,  depend  now  both  on  x  and  a.  Moreover  we  shall  allow  the  functions 
gt  to  change  with  k.  We  assume  that  for  i  -  1,...,m  and  for  k  -  0,1,... 

g*(x,a)  >  0  for  x  e  ctD,  a  >  0  » 

g*(x,a)  are  convex  in  ctD  *  i 

(39)  k 

3g 

g*(x,a)  «  (?  (ctD  *  R+),  (x,f1(x))  >  6  >  0  Vx  e  D  » 

'3^gJ(x,fi(x)).  <  V  xeD, 


where  C0  is  some  positive  constant.  Note  that  Cq,  which  is  the  upper  bound  for  the 

l. 

non  of  the  Hessian  of  g^(x>f^(x))>  does  not  depend  on  k  and  i.  We  consider  now  the 
following  iterative  procedure: 

x°  e  D  is  an  arbitrary  initial  point, 
for  k  ■  0 , 1 , . • . 


(40) 


xlt+1  e  Arg  inf  l  [g*(x,f  (x)) 

xeo  i-1 


3g 


»9? 

-  <X,  (x’',fi(x"'))>  /  (x^f^x  ))  , 


where  k  *  0,1,...  .  Por  the  procedure  (40)  we  can  prove  the  following  theorem. 
Theorem  6.  Let  the  C^(D)  functions  4(x)  and  f^(x),  i  «  1,...,m,  satisfy 


the 


conditions  of  Theorem  1  and  let  the  functions  g, (x,a)  satisfy  the  conditions  (39).  If 

.  1  k 

)c  v 

the  sequence  (x  },  determined  in  (40),  has  a  bounded  subsequence  {x  }  then 

♦(xk)  +  inf  4{x)  as  k  ♦  •  . 
x€D 

Proof.  As  in  Theorem  1  we  Introduce  the  function 


♦<x,y)  -  *(y)  +  \  (g*(x,f  (x))  -  g.(y,f.(y)) 

i-1 

»  k  .  k 

*9.  a9, 

-  <x  -  y,  ~  (y,fi(y)»J  /  jf-  (y,f1(y)>,  k  -  o,i,, 


From  (40)  it  follows  that 


.k,  k+1  k,  ,  .k,  k  k.  k. 

$  <x  ,x  )  <  ♦  (x  ,x  )  -  *(x  ) 


On  the  other  hand 


(41) 


♦k(xk*1,xk>  -  4(xk+1>  +  l  (g?(xK'M  ,fi(xx+1 ) ) 

i-1 


k,  k  ,  ,  k,,  v  k+ 1  k  1  ,  I 1  ,  ,  k... 

-  g^{x  ,t^x  ))  -  <x  -  x  ,  (x  .f^x  ))> 

3gk  3gk 

k+1  k  ’i  k  k  ’i  k  k 

-  (f^x  )  -  f1<x*))  (xK,f1(xK)))  /  ~  (xx,f  (xx>> 


Since  the  functions  g^(x,a),  1  -  1, . . . ,m,  are  convex,  from  (41)  it  follows  that 

.k,  k+1  k,  .  k+1,  .k+1,  k+1  k+1,  , 

♦  (x  ,x  )  *  *(x  )  “  4  (x  <x  ).  Thus,  as  in  Theorem  1,  we  have  the  sequence  of 


inequalities 


.  a,  k+1»  . k+ 1 ,  k+1  k+1,  „  k,  k+1  k,  „  k,  k  k,  k,  „ 

...  <  4(x  )  -  ♦  (x  ,x  )  <  ^  (x  ,x  )  <  ♦  (x  ,x  )  »  4(x  )  <  ... 


Therefore  there  exists 


now  that 


v  v  v  ip  ]r  trx  i  y  • 

li*  *(x  )  -  lim  d  (x  ,x  )  «  lim  *  (x  ,x  )  -  ♦  . 
k+*  k*«  k+» 


•  >  inf  *(x)  . 
x«D 


Then  as  in  Theorem  1  there  exist  x*  «  ctD  end  e  >  0  such  that 

_  k  k 

■jj- 4(x  ♦  T(x*  -  x  V))jT-0  <  -e  <  0 

k 

for  every  v  »  0,1,...,  where  by  the  assumption  of  the  lemma,  the  subsequence  {x  '}  is 
bounded.  Therefore  for  every  v 

d  kv  kv  kv  kv  , 

df  ♦  (*  +  T(x#  ’  x  >'x  Mt-0  <  -e  <  0 

k 

By  the  last  condition  in  (39)  and  by  the  boundedness  of  the  subsequence  {x  }  there 
exists  a  constant  M  >  0  such  that 

d2  kv  kv  kv  \ 

■ax  — -  ♦  (x  +  r(x#  -  x  ),x  )  <  M,  v  »  0,1,...  . 

T€[0, 1]  dT 

Combining  the  two  inequalities  above  we  obtain  that 


si.vJ 


//  i 

.  4-  *L 


k  k  k  k  k  k 

\1  U  M  VI  VI  VI  VI  2 

♦  (x  ♦  T(x*  -  x  ),x  w)  <  +(x  w,x  v)  -  eV2M  , 

k  *1  k  k 

«¥  V  V  V 

where  t  -  c/M.  Therefore,  recalling  that  x  e  Arg  Inf  +  (x,x  ), 

XCD 

V1  V  ,  JV  kv  V  2._ 

4  (x  ,x  )  <  ♦  (x  ,x  )  -  C  /2H 


we  have  that 


k  k  +1  k 

for  every  v.  It  la  clear  that  this  contradicts  the  fact  that  list  4  (a  #x  )  » 
k  k  k  _  v*“ 

11a  4  v(x  v,x  V)  -  i.  Thus  our  assumption  that  5  >  4(x»)  was  false.  The  theorem  is 


proved. 

Remark  1.  as  follows  from  the  proof  of  lhaoras  6,  the  second  condition  in  (39)  is 

k 

excessive.  We  only  need  to  require  that  for  every  k  the  functions  g^x.a)  are  convex 
in  the  set  M*  ■  (x  e  d|*(x)  <  *{xk)}  for  1  -  1,...,m. 


,m,  do  not  depend  on  k,  then  we  can 


Remark  2.  If  the  functions  g^x.a),  i  •  1, 
prove  for  the  procedure  (40)  the  exact  analog  of  Theorem  1  with  only  first  three  conditions 
in  (39)  and  requiring  that  g^x.a)  C  c’tclD  x  *+).  The  proof  will  be  Just  a  repetition  of 
the  proof  of  Theorem  1  with  the  function  +(x,y)  defined  as  in  Theorem  6.  The  estimates 
of  the  convergence  rates  of  the  procedure  (40)  are  also  analogous  to  those  of  Section  2  and 
we  shall  not  discuss  them  here.  Insteed  we  consider  several  important  particular  cases  of 
the  procedures  introduced  in  Sections  2,  3  and  4. 


5.  Example  1.  Ns  start  with  tha  well-known  Weber's  problem  of  finding 

m 

(42)  minw  l  wt|x  -  * 

xOT  1“1 

where  w^  are  positive  constants,  the  e^,  i  •  1, . . . ,m,  are  fixed  points  in  tP , 

|x  •  Sjl  •  [  J  (x.  -  a,.)2 J1^2.  Wsissfeld  in  {101  suggested  the  following  procedure 
i«1  3  13 

determine  the  minimising  sequence  for  the  problem  (42) i 


to 
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»  v  I  u 


x°  is  an  arbitrary  point; 


I 


for  k  «  0,1, • •« 


m  w.  a.  m  w. 

).  k  -  /  ). 

i-1  |x  -  aj  i»1  lx  - 


Weiszfeld  suggested  a  proof  of  the  convergence  of  the  procedure  (43)  which  had  several 


drawbacks,  see  [6],  related  to  the  behavior  of  the  procedure  if  one  of  the  points  xK 


coincides  with  Since  that  tine  a  number  of  papers  have  appeared  where  the  procedure 


(43)  and  its  modifications  were  considered.  He  mention  only  (4),  where  the  proof  of  the 


linear  rate  of  convergence  for  (43)  was  established  if  the  solution  of  (42)  x*  *  a1# 


i  -  and  if  the  initial  guasa  ia  close  to  x*,  [6],  where  the  procedure  (43)  is 


modified  so  that  the  proof  of  convergence  can  be  carried  out  even  if  xK  «  a^i  in  [6]  the 


convergence  was  proved  for  almost  all  initial  points.  We  refer  the  reader  to  [9]  for 


generalisations  and  bibliography. 


The  method  of  nonlinear  transformation  of  the  objective  function  allows  us  to  suggest 


a  modification  of  Weiszfeld 'a  algorithm  which  will  converge  to  x*  from  arbitrary  Initial 


point,  rirst  we  observe  that  the  original  procedure  (43)  is  simply  the  procedure  (3) 


with  f^(x)  -  WjJx  -  SjJ  ,  g4(«)  -  a  ,  i  —  1,...,m.  However  we  cannot  apply  the 


convergence  results  of  Section  2  because  the  last  condition  in  (2)  does  not  hold  if 


x  -  •i .  Thus,  we  have  to  consider  the  modified  procedure  (38)  with  g^ta)  -  a  .  He  obtain 


the  following  procedure! 


x°  is  an  arbitrary  point! 


for  k  -  0,1,.. 


-  maxtwjx*  -  aj,^*}  . 


2  2  2 
a  (x  -  a.  )  a  w.a.  a  w. 


8  Arg  min  \  — - ^ \  /  \  ~  . 

xeir  i-i  — 1  J-*  -  *—  - 


i-1  a" 


As  was  shown  in  [5]  we  can  take 


8i  "  4*  “  k'  k  "  4°  “  1 


This  is  sn  iteration  of  the  steepest  descent  method.  By  the  results  of  Section  4,  in  order 


for  the  procedure  (46)  to  converge  it  is  sufficient  that  the  coefficients  h  are  such 

V 

that  the  functions  g^(x,a)  are  convex  and  |hK|  <  CQ ,  k  «  0,1,...,  for  a  e  *+  and 

for  x  «  M*,  where  M*  -  {x  e  Rn|4(x)  <  4(xk)}. 

How  again  we  consider  the  problem  (45)  and  assume  that  4(x)  e  c2(»n).  He  take 
K  k  v 

g1(x,a)  »  a  -  #(x)  +  <H  x,x>,  where  H  is  some  symmetric  positive  definite  matrix. 

Then  the  procedure  (40)  will  have  the  form 

x°  is  an  arbitrary  point  , 

(46) 

xk+1  „  xk  _  (Hk)-1V#(x,t)  . 

From  the  results  of  Section  4  it  follows  that  the  procedure  (46)  will  converge  to  the 
solution  of  (45)  if  IHkl  <  CQ  and  gk(x,a)  are  convex  for  k  -  0,1,...,  a  >  0, 
x  e  Mk  -  {x |*(x)  <  4(xk)}.  Of  course  if  H*  is  H(xk),  where  H(x)  is  the  Hessian 
matrix  of  the  function  *(x),  (46)  is  an  iteration  of  Newton's  method.  Note  that  the 

fixed  point  method  is  also  a  particular  case  of  the  procedure  (40). 

6.  Finally  we  consider  a  version  of  the  method  of  nonlinear  transformation  of  the 

objective  function  without  which  our  presentation  of  that  method  undoubtedly  would  not  be 

complete.  Xn  this  section  we  consider  the  case  when  the  transforming  functions  g^a)  are 

concave.  He  assume  that 

D  is  a  closed  bounded  convex  set  in  R0 t 

2 

(47)  the  functions  g^fa)  e  c  (0,»)  and  are  convex) 

g'(fi(x))  >  S  >  0,  |gj(f1(x))|  <  T,  x  «  D,  i  -  1 . . . 

the  functions  gi(f1(x))  are  convex  for  x  e  Di 
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where  5  and  y  are  some  positive  constants.  Note  that  these  conditions  will  allow  us  to 


consider  in  our  method  such  functions  g^(a)  as  tn  a,  a  ,  0  <  p  <  1,  etc.  As  usual  we 


assume  that  the  functions  (^(fj^x)).  i  «  1,...,m,  are  simple  (for  example,  quadratic) 


and  that  the  linear  combination  \  Cjg^fj^x))  can  be  minimised  on  D  with  less  effort 

i-1 

than  *<x)  for  every  set  of  positive  coefficients  c1,...,cB).  Consider  now  the  following 


procedure : 


xu  e  D  is  an  arbitrary  point »  for  k  -  0,1, 


5  -  min  \  gi<f1(x))/g!(fi(xk))  , 

i-1 


min  IgJtBJl/g'C^tx^)),  i  -  1 . . 


0elf1(xk),f1(5k)l 


JK  -  {J  «  Cl . m}|dk  +  T(Ck  -  *k>))|T.0  <  0} 


X  \  „k k,  ,k  k,2  .  v  ,rx.  x,  K\\J 

o-l  M  a  (C  -  X  )  ♦  l  m  (f  (C  )  -  f.(x  )) 

i«j  iw 


Jc...  ,,k. 


ak  »  mln{  1 ,  \  [g^ixN)  -  g^uN  M/g[(fi<xk>  > , 


<J  1-1 


xk+1  -  xk  +  ak(Ck  -  xk) 


Theorem  7.  Assume  that  the  conditions  (47)  hold  and  that  the  functions  f^tx) , 


i  -  1 , . . . ,m,  are  non-negative  and  convex  in  P.  Then 


#(x  )  ♦  4(x*)  as  k  ♦  •  , 


where  x*  €  Arg  min  #(x). 

xeo 

Proof.  We  introduce  the  function 


G*(x>  -  1  g1(f1(x))/g^(fi(xk)) 


Since  for  every  k  -  0,1,...  the  point  *  is  a  point  of  minimum  of  the  function  G^x), 


Gk<£  )  -  G^x*)  <  Gk<**)  -  Gfc'x  > 


l  (gi(f1(x*>)  -  gi(fi(xk))]/g[(fi(xlt)) 


By  concavity  of  g^tcO,  i-1, •••»■, 


).  gi(fi(x*))  -  gi(fi(xk))/g|(fi(x,c)) 
i-1 


<  J.  tfi<x*>  -  fiCxk)l  -  *{x*)  -  <Mx  ). 


Thus 

(49) 


G  (5k)  -  Gjt(xk)  <  *(x*>  -  *(xk)  . 


On  the  other  hand,  by  convexity  of  the  functions  f^x),  i  -  1, 
G^Cx**1)  -  G^lx5*)  »  *(xk+1)  -  *(xk) 


(50) 


m  . 

+  1  (91(«i(xk  ♦  a  (C  -  xk)))  -  g1(fi(xk)) 


i-1 


-  gi(f1(xk))(f1(xk+1>  -  fi(xk)))/gi(f1(xk)) 

>  ♦(x*M)  -  4(xk)  -  J  1  Mk[fi(xk  +  ak(Ek  -  x1 


)) 


i-1 


-  fi(xk)]2  >  *(xk+1)  -  4(xk> 


j  (.Vf^  -  «V  ^  i^jk  ' 


k..2, 


where  the  set  Jk  and  constants  Mk,dk  and  ak  are  defined  in  (48).  Recalling  the 
definition  of  <Jk  in  (48)  we  obtain  from  (50)  the  following  inequality! 


4(xk+1)  -  *(xk)  <  Gk(xk+1)  -  Gk(xk)  +  j  ok(ak)2,  k  -  0,1,. 
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will  be  considered  in  the  forthcoming  paper 


REFERENCES 


[1]  Eydeland,  A.,  "A  Method  of  Solving  Nonlinear  Variational  Problems  by  Nonlinear 
Transformation  of  the  Objective  Functional,  Part  I",  Numer.  Math.  43  (1964),  59-62. 

[2]  Eydeland,  A.,  "A  Method  of  Solving  Nonlinear  Variational  Problems  by  Nonlinear 
Transformation  of  the  Objective  Functional,  Part  II”,  Numer.  Math.,  to  appear. 

[3]  Eydeland,  A.,  "Method  of  Transformation  of  the  Objective  Function”,  In:  Problems  of 
math,  simulation.  Radio  and  Electronics  Inst,  of  Acad,  of  Sci.  of  the  USSR  (1979), 
79-86  ( in  Russian ) . 

[4]  Katz,  N.,  "On  the  Convergence  of  a  Numerical  Scheme  for  Solving  Some  Locational 
Equilibrium  Problems",  SIAM  J.  Appl.  Math.  17,  No.  6  (1969),  1224-1231. 

[5]  Korobochkin,  B.  and  A.  Eydeland,  "Application  of  the  objective  function  transformation 
method  to  one  class  of  optimization  problems".  In:  Math,  methods  of  solving  econom. 
problems,  Nauka,  Moscow  (1980),  72-84  (in  Russian). 

[6]  Kuhn,  H.  W. ,  "A  Note  on  Fermat  Problem",  Math.  Progr.  4  (1973),  98-107. 

[7]  Overt on,  M. ,  "A  Quadratically  Convergent  Method  for  Minimizing  a  Sum  of  Euclidean 

Norms",  Techn.  Report  No.  30,  Courant  Inst,  of  Math.  Sci.,  New  York  (1981). 

[81  Rockafellar,  R.  T. ,  "Convex  Analysis",  Princeton  Univ.  Press,  Princeton,  N.J.  (1972). 

[9]  Voss,  H.  and  U.  Eckhardt,  "Linear  Convergence  of  Generalized  Weiszfeld's  Method", 

Computing  25  (1980),  243-257. 

[10]  Weiszfeld,  E. ,  "Sur  le  point  par  lequel  la  Somme  dee  distances  de  n  points  donnes  est 
minimum",  Tohuku  Math.  Journal  43  (1937),  355-386. 


AB/ed 


-25- 


i.''  -• 


.  .. 


SECURITY  CLASSIFICATION  OP  THIS  PAGE  ( When  Data  Entered) 


REPORT  DOCUMENTATION  PAGE 


I.  REPORT  NUMBER 

2699 


2.  GOVT  ACCESSION  NO. 


4.  TITLE  (end  Subtitle) 


VUhAMA 


GLOBALLY  CONVERGENT  PROCEDURES  FOR  SOLVING 
NONLINEAR  MINIMIZATION  PROBLEMS 


T.  AUTHORS 

Alexander  Eydeland 


S.  PERFORMING  ORGANIZATION  NAME  ANO  ADDRESS 


Mathematics  Research  Center,  University  of 
610  Walnut  Street  Wisconsin 

Madison.  Wisconsin  53706 


It.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 


(See  Item  18  below) 

1 4.  MONITORING  lOEN^Y  N AME  •  AOORESSf/f  duferent  tram  Cantraltfnd  Oltlce) 


Is.  DISTRIBUTION  STATEMENT  (el  «a  JtaparO  ~ 

Approved  for  public  release;  distribution  unlimited. 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


S.  RECIPIENT'S  CATALOG  NUMBER 


US 


8.  TYPE  OP  REPORT  A  PERIOD  COVERED 

Summary  Report  -  no  specific 
reporting  period _ 


S.  PERFORMING  ORG.  REPORT  NUMBER 


S.  CONTRACT  OR  GRANT  NUMBERS) 

MCS-8301628 
DAAG29-80-C-00  41 
MCS-82 10950 


10.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  A  WORK  UNIT  NUMBERS 

Work  Unit  Number  5  - 
Optimization  and  Large 
Scale  Systems 


<2.  REPORT  DATE 

May  1984 


ts.  NUMBER  of  pages 

25 


ts.  SECURITY  CLASS,  (o I  title  report) 


UNCLASSIFIED 


isa.  declassification/downgrading 
schedule 


17.  DISTRIBUTION  STATEMENT  (ol  the  aba  tract  entered  In  Block  20.  II  dIMoront  hem  Report) 


IB.  SUPPLEMENTARY  NOTES 

U.  S.  Army  Research  Office 
P.  O.  Box  12211 
Research  Triangle  Park 
North  Carolina  27709 


National  Science  Foundation 
Washington,  DC  20550 


10.  KEY  WORDS  (Continue  an  toooroo  cldc  II  neceeeery  end  Identify  by  Nock  number) 


Nonlinear  minimization  problem,  globally  convergent  minimization  procedure, 
transformation  of  the  objective  function 


20.  ABSTRACT  fCantlnun  an  raaaraa  cldc  II  neceeeery  end  Identify  by  block  number) 

In  this  work  we  describe  globally  convergent  iterative  procedures  for 


generating  a  minimizing  sequence  for  the  problem  of  finding  the  infimum  for 
the  function  *(x)  »  )  f^x)  on  a  certain  set  D.  The  minimizing 
sequence  consists  of  points  of  the  infimum  for  functions  of  the  type 


DO  I  jan*7S  1473  EDITION  OF  1  NOV  AS  IS  OBSOLETE 


UNCLASSIFIED 


(cont. ) 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (When  Data  Bntorod) 


m 


mi 


/  V  . 


ABSTRACT  (cont. ) 


)_  [B^(g  (x,ff^(x))  +  <y^,x>] ,  where  the  transforming  functions  g^x,*)  are 
chosen  in  such  a  way  that  the  compositions  g^(x,f^(x))  are  simpler  than  the 
given  functions  f^x),  and  where  the  coefficients  0i  >0,  y^  e  Rn, 


i  *  1,...,m,  are  determined  by  the  choice  of  g^.  Various  classes  of  the 


functions  g^  are  considered  and  global  convergence  results  are  proved.  It 


is  shown  that  many  well-known  algorithms,  for  example,  Weiszfeld's  algorithm 


and  Newton's  method  are  particular  cases  of  the  general  method. 


-.■TVS 


